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START 


INPUT: 
SERIES 
NR.  LAGS 


CALCULATE 
ft  PRINT 

MEAN,  VARIANCE 


CALCULATE 
ft  PRINT 

AUTOCOVARIANCE 
ft  AUTOCORRELATION 


CALCULATE  ft 
PRINT  PARTIAL 
AUTOCORRELATION 


Figure  A-1,  Flow  Chart  for  Calculating  Estimates  of  Auto- 
correlation and  Partial  Autocorrelation  Functions. 

2.  Preliminary  Estimates  of  Parameters 

The  equations  for  calculating  preliminary  estimates  of  the 
parameters  for  the  Identified  model  are  given  In  Chapter  2 [ (Equations 
(2.38)  through  (2.42)]  and  will  not  be  repeated  here.  Figure  A-2  Is 
a flow  chart  for  Implementing  these  equations.  As  shown  In  the  flow 
chart,  the  tolerance  on  the  f vector  has  been  set  at  0.0001.  Any  other 
value  appropriate  to  the  particular  problem  could  be  used.  Table  A- II 
contains  the  BASIC  program  listing. 
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START 


AR  - AUTOREGRESSIVE 
MA  - MOVING  AVERAGE 


INPUT: 

'ar  order 

MA  ORDER 
AUTOCOVARIANCES 


AR  ORDER 
. -0? 


CALCULATE 
AR  PARAMETERS 


CALCULATE 

MODIFIED 

AUTOCOVARIANCES 


CALCULATE 

T.f 

VECTORS 


CALCULATE 

MA 

PARAMETERS 


CALCULATE 
r MATRIX 
h VECTOR 


Figure  A-2.  Flow  Chart  For  Calculating  Preliminary  Estimates  of 
Model  Parameters. 


f 
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TABLE  A-I.  BASIC  PROGRAM  LISTING  F(»  CALCULATING  ESTIMATES  OF 
! AUTOCORRELATION  AM)  PARTIAL  AUTOC(»RELATION  FUNCTIONS 


I 

i 


i 

I 


10  DIM  I 

15  «»=•■ I " I 

20  DISF  "ENTER  DftTfl  FILE  NR"! 

30  INPUI  r i 

40  LOftD  IiRTR  F.Z 
50  DISP  "ENTER  NR  LFlGS"! 

60  INPUT  k 

70  DISP  "ENTER  NR  SAMPLES' ! 

60  INPUT  N 
90  S 1 *0 

100  v2»0  I 

110  FOP  1=1  TO  N 

120  Sl  = S:+2l  I 1 

130  nej:t  1 

140  N='S1  N 

150  S1“0 

160  FOR  1=1  TO  N 
170  Nt  1 >’[  1 j-M 
ISO  S1=S1+NC  ! 3 
190  s3=3;;+w[  1 I j 
200  NEXT  1 
210  V2=S2  <N-1) 

215  PRINT  "MEAM="iMi  "VhRImNCE--"!  0 
220  FOP  J-i  TO  L 
230  33=0 

240  FOR  !=1  TO  N-J 
250  L=l  + .i 

260  S3»S3»WCL  ]*-W[  I 3 
270  NEXT  1 
280  C[J]  = S3/N 
290  Rtj3=ClJ)'V2 
200  NEXT  J 

310  PRINT  "Lhf.  hCV 

312  PRINT  y ■ ; V2 

314  FOR  J=I  TO  K ! 

316  PRINT  j;i:[-i3  ' 

318  NEXT  J 
320  URITL  15.322' 

222  FORMAT  . AUTOCOPPELA  I' ION  FUNM  ION  . , 29X.  " - 1'  . '^X.  O . 9X  - " 1 . .SuX-Sl'T 
324  FOP  J=1  Tu  1 
32t>  E»  = 

328  IF  RC  I3nH  THEN  338 
330  M=1N1  • lO-^Rl  Jl+O.  5 ' 

332  L'il  i:  llT|l3  = ATt  1 1.  11  IN3 

336  GOTO  345  , 

338  N=INTa0*Rt  J 3+0.  5) 

340  Ei*[  11+N.  1 I l=AtC  1 1+N,  1 1 3 ' . 

345  PRINT  J1R[ J1.TAB29.BT 
350  NEXT  .. 
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TABLE  A-1.  (CONCLUDED) 


JfO  r(  1 . 1 )>l(l  I I 
3:0  fOR  l*>  10  ► 

N-W 

V-0 

40B  FOR  )•)  ni  I I 
410  S»X«Fl  J -1 . > l*Kl  l-J  > 

4i0  . • ' »Fl  I I • • 1‘hl  -'  ' 

4 '.0  t.ENI  I 

4 40  M t • I I->Rl  I 1 N ‘ I > 

450  Fl'F  -I  10  1 1 

4eO  PU  . I )-Pl  1 I . M U I • 1 1 11  .'1 

4 70  Ml  aT  I 

400  Mt  ,t  I 

4»0  WRlTf  f'>  4 • 

4'»j  roFMi  ’ . trui!i4i  MU’  'V  0*  m ir  u ■(  r.iii  ’uti  . 

4'44  print  (ho  -u>  n 1 1 1 1 11 1 n m I n m n 1 
4M^  mtr  iM  10  ► 

4M0  01* 

500  IF  PM  • I »■  u un  N ^ ;»• 

50J  N-INT  t.wF't  I . I )*0.  ^ ' 

510  H»l  11  • 1 1 •»!  1*Mll  I 1 . I I •!)  1 
5.0  GOTO  >0 

SiO  N-INI  . 10*PI  !•  I 1*0. -S' 

540  Pit  n *0. 11  l*H«l  I I ♦N.  1 1 1 
^oO  F'F'IN'  IIP!  ’.I  ).IhF."4.H» 

5.'o  MINI  : 

5P0  tNP 


imB  A-Il.  BASIC  PROGRAM  LISTING  FOR  CALCULATING  PRELIMINARY 
ESTIMATES  OF  MODEL  PARAtSTSRS 

lO  REM  P^ELiMlUrtPV  ESTIMATE  OF  HFflA  FHFHMETERS 

20  DIM  RSC  10.  10I.PSC  10.  10]»FSC  lOl.TSC  10  J.lSI  lOI.PSt  lOJ.OSC  10  1 

30  DISP  "ENTER  P.0"t 

40  INPUT  F*.  .01 

50  FOR  J-1  TO  10 

60  DISP  "ENTER  C< " ! J I " ) " ? 

70  INPUT  CtJ] 

60  NEXT  i 

90  IF  Fl-o  THEN  4t.U 

100  PEP!M  AIPl.Pn.OIPn.PIPn.BI  M.F  1 1 

110  FOR  U1  10  PI 

120  FOR  J»1  TO  FI 

130  k3ftfciS<Qi»l-j'+i 

140  Ml  1 . J j»Cl  1 1 

150  NEST  J 

160  OC I I'Cl  Ol*I  + l I 

170  NEXT  I 

180  IF  DET'  A''=0  THEN  240 
190  MFiT  E*IN\CA' 

200  Mm  I R“b*w 

210  PRINT  "AUTOREGRESSIVE  PARAMETERS  ARE- 
220  MAT  PRINT  P 

222  S1=CC 1 1 

223  FOR  .1=1  TO  PI 

224  si=si-p:  .i]*CC  J-H  3 

225  NEXT  I 
230  GOTO  260 

240  PRINT  "A  NOT  INVERTIBLE" 

250  STOP 

260  IF  01 -0  •"HEN  770 

262  REDIM  C3C01  + I J.Pt  Pl  + 1 1 

265  FOR  .1=1  TO  Ql-H 

275  PC  1 1=0 

280  FOR  I-;  TO  RUl 

285  li=0 

290  FOR  t =1  TO  PIM 
300  IF  K 1 THEN  320 
310  X=-l 
315  GOTO  330 
320 

330  L=ABS.  JH-l.-l  '■♦1 

340  D»D<-X*Cri  3 

350  NEXT  k 

360  IF  I t THEN  380 

365  V=-l 

370  GOTO  o ■*0 

380  Y=Pt 1-13 

390  OC  J3*P[  J3+Y+II 

400  NEXT  1 

410  NEXT  J 

420  FOP  ,1=1  TO  OUl 

4 30  CC.l3=0rj] 

440  NEXT  1 

450  REDIM  TIPI  *1  3.H  01  + 1 j.  At  Pl  + l.i'l  t , J.  Bt  Pl  + l.01  + 1 3.H[  iv'l-*  l J.  OLQl  ♦!  3 

460  Tf  1 3=  ri  ! 3,' to.  5 

470  FOR  .1=2  10  01  + 1 

480  TC  J 1=0 

486  NEXT  J 

490  FOR  .1=0  rO  01 

500  D=o 


xox 


r 


r 


‘1 


TABLE  A-II.  (CONCLUDED) 


?ie  FOB  ro  01 -J 
52»  D-D*TC !♦!  1«T[ I» j»l  3 
53®  NEXT  1 
5-»e  FT  .1*1  ]»D-C[  .Ul  ] 

550  ne;ct  I 

552  2«0 

554  FOB  J-1  TO  01 M 

555  IF  Mt!>'F[JJ'  0.0001  THEN  557 

556  ;«2*l 

557  NEXT  J 
55S  PRINT  2 

554  IF  2*0  THFH  7~0 
560  MfiT  R»2Et> 

570  MHT  f TEt- 
57*i  TINT  t-kW'  F 
5S0  FOB  I-O  TO  01 

54^)  fob  ,1-0  ro  01 -1 

600  H[  I ♦ 1 . .!♦  1 1 = TT  W ; ♦ 1 I 

610  NEXT  I 

e2o  HEM  1 

630  FOB  T*l  Tu  0! +1 

640  FOP  .1*1  TO  01  »1 

650  E'f  I • < ]=Tr  J-I  • 1 3 

660  NEXT  .1 

670  NEXT  I 

660  MOT 

640  IF  rtTvR'^O  THEN  750 
700  MHT  6*INViH/ 

710  Mfil  Q*B*F 
730  MHT  1*3-0 
740  GOTO  440 

750  PRINT  T MHTBIX  MOT  INVEFTIEslE' 

760  STOP 
770  X-1 

7S0  IF  Pl-!0  then  620 
740  FOP  1*1  TO  Pi 
600  : ..i 

SIO  NEXT 

820  PRINT  OVEFHIL  lONSTHNT»IJ  BHB  TIMES  ;x 

625  IE  0l-*0  THEN  41U 

830  BEDIM  OtOn 

840  FOB  .1*1  TO  01 

8‘^0  01  1 3=-T[  .i<-l  3 TC  1 3 

860  NEXT  I 

870  PRINT  moving  HVFFHCE  PHPRMFTEkv  4PE " 

880  MAT  PRINT  V 

840  IF  01*0  THEN  410 

400  Sl=Tt 1 3t2 

410  PBINI  -RESIDUHL  VHBIHNCE  lo  :S1 
420  END 
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Appendix  B 

OPTIMIZATION  ALGORITHMS 

Finding  m roaxlmum  likelihood  estimate  of  the  parameters  and 
starting  values  for  the  time  series  model  requires  finding  the  set  of 
parameters  and  starting  values  that  minimises  the  sum  of  the  squared 
residuals.  Any  stationary  ARMA  model  can  be  written  In  Che  form 

a^  - (w^  - w)  - - w)  - ...  - ♦ (w^  - w) 


+ •••  %‘t.q  . 


(B.l) 


where 


t-1 


Given  p Initial  values  of  the  w's  and  q initial  values  of  the  a's. 
Equation  (B.l)  can  be  solved  recursively  to  obtain  Che  sequence  a^. 


from  which  Che  sum  of  squares, 
n 
S 

t-1 


-I-? 


(B.2) 


Is  calculated.  Letting^  - (w,  Wj^ w^,  ♦p*  d ^ , . . . , be  the 

vector  of  parameters  to  be  estimated,  the  vector^*  that  minimises  S can  be 
found  by  any  of  the  well-known  optimisation  algorithms.  Three  algo- 
rithms, an  exhaustive  grid  search,  a linearised  regression,  and  a pattern 
search,  were  used  In  this  Investigation,  and  are  described  here.  In 
Implementing  all  of  these  algorithms  on  the  Hewlett-Packard  9830,  the 

103 


r 


\ 


: 


f ‘ 


h 


appropriate  form  of  Equation  (B.l)  waa  input  as  a defined  function, 
and  the  q initial  values  of  the  residuals  were  set  equal  to  sero.  Also, 
the  check  for  stationarity  and  invertibility  was  performed  off-line. 
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1.  Grid  Search 

The  grid  search  is  a simple  exhaustive  search  routine  in  which 

each  element  of  the  vector,  is  systemat  ically  allowed  to  take  on  each  of  a 

set  of  predetermined  values.  For  instance,  if  1.  “(t  ,...6  ) , then 

’ ■“‘o  ol  oj  'om  ’ 

i is  allowed  to  take  on  values  (1^,^  • • • ^ ^ l r * * ^oj * * * ’ 

•••’  ^^U'**^oJ*‘*^om^’  •••’ 

bination  of  elements  has  been  used.  That  combination  which  minimizes 
S is  an  estimate  of  the  best  value  of 

The  exhaustive  grid  search  is  not  very  useful  for  finding  an 
opt  Inxim  value  for  the  parameter  vector,^,  simply  because  it  requires  a large 

number  of  trials  (m*'where  m is  the  dimension  of  ^and  n is  the  number  of  values 
tried  for  each  element ) to  search  a very  large  parameter  space  and  the  resolu- 
tion is  dependent  on  the  interval  between  values  of  the  elements.  However,  it 
is  useful  for  mapping  contours  of  the  sum  of  squares  function  and  for  examining 
behavior  in  the  vicinity  of  an  estimate  of  the  optimum  point.  Figure  B-1  is  a 
flow  chart  for  this  algorithm;  Table  B-I  is  the  computer  program  listing. 

2.  Linearized  Regression 

Suppose  that  Equation  (B.l)  is  written  as 

(B.3) 

where  f is  some  function  of  the  parameter  vector,  Let  ^ be  of 
dimension  m.  Expanding  a^  in  a Taylor's  series  about  some  guessed 

parameter  vector,  and  neglecting  higher  order  terms  gives 
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SET  VALUES 
OFt 


CALCULATE 
A PRINT  S.I 


ALL  ^ 
VALUES  OF 
{ TRIED7  ^ 


INCREMENT 


Figure  B-1.  Flow  Chart  for  Grid  Search  Algorithm 


XAOLE  b>i.  basic  program  listing  for  grid  search 

ALGORITHM 


10  PEM  CONliP’OlWL  lLmST  CQUhh  ES  Gt- 1 1'  GFAKCH  WITH  STORT 
1'  Pier  PEKIMf  eooo  ■ 

IT  STOP 

20  DIM  HjC20o].we[wU0J«r'jI  10.5].  ISt  lu. 51. MC5]«BSt  10.51 
25  S5»1E+51 

30  DI3P  "ENTtR  FILE  NE . HR  PTS"5 
40  INPUT  Hl.N 
50  LORD  PmTR  Ml-U 

t-O  DieE'  tNTEE  (IRP  > Utr  i"  MP  '.iRDLE  i 
:0  INPUT  .l.F' 

SO  DISF  EHTF>  * Mh  rnEF?.  Mm  ORDFK' ‘ 

30  INPUT  12.01 
100  FOP  11  TO  LI 

110  DISK  tN'LK  F .i:  -..  DElTrt.  F -.TOf  1 
120  INPUT  PI  1. 1 i.pl  1.2  1. pi  I.:  J 
130  he:;i  I 
140  FOR  I--1  TI.  L2 

150  P13P  LNTth-  :i:  ..  PELIH.  1 ..TOF  S 
ISO  INPUT  n I • 1 ].  TI  1 ..  1.  T1  I .2  1 

170  ne:  t I 

172  DIEP  "LtrEP  MEmN.  DELTR.  STOP  : 

175  IMP'J’  MI  ' !■  MI  ; 1.  MI  3 1 
ISO  03*P1 

130  IF  PI  01  THEN  203 
200  03=01 

203  FOR  i=l  TO  03 

204  DISP  •ENTER  B-  1 1 1 •>  - DELT  R.  STOP  ' : 

205  INPUT  LII  . 1 l.Pt  1 ..  l.EM  . M 
20S  Bt  1.'.  I = BI  1.11 

207  NEXT  I 
210  FOR  l-I  TO  LI 
220  Pn.4  1=P[  I.  11 
225  NEXT 

230  POP  ; = U + u3  Til  i.  , + l STLF  -1 
234  WI  l-ljrj-03] 

23t.  NE,;T  .1 
240  FOP  1=1  TO  L2 
250  Tt  I,-*  1-TL  I.  n 
2S0  NEXT  I 
2R2  MI  4 1 MI  1 j 
270  FOP  I-!  TO  LI 
?yO  FOP  > 1 T I_ 

285  FOR  1=1  TO  05 

230  GOSUB  2000 

2'=>2  BI  L.  1 1 = BI  L . 1 1 + Bl  1.21 

234  IF  eCL.Il  « BIL...  1 THEN  230 

236  BIL.  1 ]=BtL.4  1 

238  NEXT  L 

300  TIF  . I 1»TI1  . 1 >ri  K.21 

310  IF  TIG. 1 1 = Til  . ] THEN  285 

220  TIF  . 1 ] = TtF  .4  1 

330  NEXT  t 

340  PI  !.  1 1 PI  I. 1 JiPI  1.2  1 

345  IF  Pil.ll  = PI1.31  THEN  280 

350  PC  I.  1 1--PI  1.4  1 

360  NEXT  I 

370  MI  1 1 = MI  1 1 + MI  2 1 

380  IF  MI  1 1 <•=  Ml  3 1 THEN  270  . 

330  MI  1 ] = nt  4 1 


,t«V* 
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TABLE  B-I.  (CCETTINUED) 


PRINT  "Bi  ST  POINI  ■■ 

PRINT  ? ] 

POP  .'■>!  TO  Li 

PRINT  'THl ji  pt  j,  5 ] 

NEXT  i 

FOP  J«1  TO  LJ- 

PRINT  "THETR  ("i I 
NEXT  J 

FCR  1*1  ID  Qi 

PRINT  "Nv  i Ji  " JBC  J.M 

NEXT  J 

PRINT  "MIN  Si*  : ••VRRIHNCP*"  : M 

PRINT  "PRtiS  C'lNT  TO  RECORD  P''b I DUnlS' 
PRINT 
STOP 

MC  1 I'Mt  5 ’ 

PuR  J*1  !0  Li 

PL  J.  1 ] = Pt  I.  5 J 
NEXT  I 

FOP  .1=1  ■'0  LL 
TI  J.  I I = TL  J.5  ] 

NEXT  I 

roF  I : ’■n  or 
E:t  J.  1 ]=E![  U5  3 
NEXT  .1 

uosue  2000 

FOP  .1=1  TO  N 
R[  J3  = R[  J*00] 

NE  nT  .1 

DIsP  INPUT  FILE  NR  FOR  RE'^IDUHL^': 
INPUT  RJ 

STORF  DmTh  R2-0 
STOP 

.T  FOR  .1=1  ru  03 

^ NC  J ]=&[  ,1.  1 1 

' PRINT  ■•|ji  ; j:  • =":wt  j] 

> hi  J 3 = 0 

f he::t  j 

) Sl*0 

J POR  .1=0  »;  TO  N»0  3 

? Ml  J l=p  Nh  J ' 

3 M ='' i*Nc  n: 

) * E'" 

) S2=il  N 

5 PRINT  'MENN*  SML  1 I 
) FOP  1=1  TO  Lt 
3 PRINT  -phU-J  Ji  •->  = -:pt  J,  1 I 
) NEXT  J 
* FOR  -i=i  T(i  Lfi- 

» PRINT  "THETN  v"!J!"^=  i TL J. M 
' NEXT  J 

! IF  S’  '=  s5  THEN  2154 
! Mt51=N[  1 1 
I FOR  J=I  ’’U  LI 
i PC  J«  5 I*!-!  J.  1 1 
; NEXT  J 
■ FOR  J=1  TU  L2 
f t:  j.=.j»Tr  J.  1 J 


mis  PAOT  IS  BBST  QUALITY  FRACTICABL* 
UtOM  (XffY  FUKWiiriSU  10  ODC  — ^ 
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TABLE  B-I 


(CONCLUDED) 


2150 

2151 

2152 

2153 

2154 

2155 
21(J0 
2170 
5000 
5010 
5020 


N€>:T  .1 

FOK  .1=1  TO  03 

ec  j«5  j=ec  j»  1 1 

NEXT  .1 
35=S: 

PRINT  "SUM  SQUPFES  = ‘'!Sr* '■'.'HF;IONCE  = ’ ;S2 

PRINT 

RETURN 

END 

G = NC  T l-Rt  1 « I I’Nl  T-  1 1-PC  1 J’UC  T-2  3-  Mt  1 ]*  U -PC  1 • 1 3-Pt  *;<  1 3 '+TC 
RETURN  G 


isf^^ 
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*t  ■ *t,o  ■ 2 *l,t 


(B.4) 


where  given  the  sequence  (w,  - w) , ...  (w  - w)  and  1 ■ t i 

t ,0  c 1 n “ 


while 


^ t-e.  • 


Rearranging  Equation  (B.4), 


III 

‘t,o  “ *l,t  “t 


(B.5) 


Tlie  set  o£  Equations  (B.5)  at  each  value  of  t,  t <■  1,  2,  ...  n,  can 


be  written  as  the  matrix  equation 
o o t 


(B.6) 


where  x Is  the  nxm  matrix  (x,  ) and  ^ and  £ are  column  vectors  with  n 

elements.  Equation  (B.6)  Is  In  the  proper  form  for  a linear  regression 

of  the  a 's  onto  the  x's;  therefore,  the  value  of  the  vector  (^  - ^ ) 
o o 

which  minimizes 


V 2 T 

s “ Z ®t  " - - 


can  be  found  by  the  well-known  solution  of  the  normal  equations  for 


linear  least  squares  regression.  Thus,  a minimum  occurs  when 
T -1  T 

o o 


(B.7) 


In  general,  the  ''ot  strictly  linear  in  the  parameters, 

Hence,  a single  calculation  of  (J^  - _^^)  will  not  produce  a minimum  sum 


of  the  squared  residuals.  Repeated  application  of  the  process  with  the 


109 


new  value  ol  ^ substituted  for  ^ will  usually  result  In  convergence  11 
the  Initial  estimates  of  the  parameters  are  reasonably  good  guesses. 
Caution  naiat  be  oaerclsed  when  using  this  algorithm  whan  the  process 
Is  close  to  nonstatlonarlty  or  nonlnvertlblllty , because  the  Indicated 
optimum  can  easily  bo  In  a region  of  Infeaslbll Ity,  While  the  partial 
derivatives  may  be  obtained  directly,  It  la  usually  much  easier  to 
obtain  numerical  estimates  to  sufficient  accuracy  using  the  relationship 


■ l(w  - w). 


- ^l,o“*^l,o 

wl»ere  tw  - w)  Is  tl^e  vector  consisting  of  elements  ol  tl>c  time  series. 

In  implementing  this  algorltim,  the  value  of  tlic  sum  of  squared 
residuals,  S(Ot  calculated  for  each  solution  of  the  parameter 
vector,  If  S(^  > S(J^),  the  vector  difference,  ^ Is  halved 

and  S(f,)  is  calculated  at  the  now  estimate  of  This  process  is 
repeated  until  some,  value  S(^  < until  the  absolute  value  of 

each  clement  of  llie  vector  difference,  ( t - 1 ) . Is  loss  than  tl»c  cor- 


responding element  of  some  tolerance  vector,  £,  in  wl»lch  case  con- 
vergence is  assumed  to  have  occurred.  Figure  B-2  is  a flow  ciiart  ol 
tl)e  linearir.ed  regression  algorithm;  Table  B-II  is  the  program  llstlitg. 

3.  I’attern  Search 

Tlie  pattern  search  Is  a heuristic  algorithm  that  lias  tlie 
advantages  ol  accelerating  and  following  ridges.  It  works  as  follows. 
Tlic  inltal  estimate  of  the  parameter  vector,  is  designated  as  a 
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Figure  B-2,  Flow  Chart  For  Linearized  Regression  Algorithm 


TABLE  B-II.  BASIC  PROGRAM  LISTING  FOR  LINEARIZED 
REGRESSION  ALGORITHM 


1 DISP  IiEFIHF  FUNCTIONS  RcT)"J 

9 STOP 

10  PEN  NONLINERP  LEHST  SOUhRES  with  STiiRTING  VRLUES 

20  DIM  WSC  200  J>RSC  150  IiPSC  10  J.  rSC  101.  XSC  150»  in.'iSC  U»  1 1 I 
30  DIM  GS(  in.NSC  lll'USt  1 1. 11  Ki3.It;.C  in 
40  DISP  " ENTER  FILE  Nft.NR  PTS"! 

50  INPUT  fil.N 

51  LORD  DRTH  Hl-W 

60  DISP  ENTER  • HP  COEFS,  fiP  ORDER"; 

61  INPUT  LIjPI 

62  DISP  "ENTER  « Mn  COEFS-  MH  ORDER  ; 
t3  INPUT  l2.01 

64  FOP  R-'l  TO  LI 

65  DISP  ENTER  PHI  - " ; K ; " > " ; 

66  INPUT  PIKT 

67  NEXT 

66  FOR  ►-!  Tu  L2 

69  DISP  "ENTER  THETn  ' IRl  ■ 

70  INPI.1T  T[M 

71  NEXT  K 

72  DISP  ' ENTER  COEF  TOLEREnCE' : 

73  INPUT  D2 

74  DISP  ENTER  U BhR"; 

75  INPUT  Wl 

76  L3^F1 

77  IF  Ol'F'l  IHEN  oO 

78  L3=Q1 

80  FOP  K-1  TO  L3 

85  DISP  •ENTER  Ei'  "IK  ; " : 

90  INPUT  BtK  T 
95  NEXT  K 

100  FOP  l=N  lO  1 STEP  -1 
110  WC  I + L i )-Wt  I ] 

120  ne;:t  1 

250  P5=0.5 
260  GOSUE:  SOOO 
270  Z=S1 

280  FOR  ,1=1  TO  N + L3 

290  xr  '•  ' I '=Hr  •] 


TOLEREnCE'  : 


290  xr  '• ' I '=Hr  •] 

300  NEXT  ! 

302  M=0 

3u5  IF  W1=U  THEN  410 

306  rf=i 

310  Z1=U1 

320  W1=Z1  < I . oOliOi 

330  GOSUE:  30oo 

340  FOP  J=1  TO  H+LS 

350  IF  W1=0  THEN  380 

360  XC  J.  1 ]=<XC  J.  11  3 fit  J3''  (0.00001-21  ) 
370  GOTO  390 
380  XE  J. 1 3=0 

385  NEXT  .1 

386  GOTO  4i0 

390  Wl=21  i 

400  NEXT  J 

410  FOP  L = 1 '■O  LI 

420  ZnPCL  3 

430  PC  L 3=Z1 *1 . 00001 

440  GOSUP  "^ii-iO 
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TABLE  B-II.  (CCmriNUED) 


450  FOR  J«1  TO  N+L3 

460  XC  JiL+MXXC  J»  11  ]-flC  J])/<;0.00O01»21> 

, 470  NEXT  J 

I 480  PCL]=21 

. 490  NEXT  L 

495  22=L1 

500  FOR  L=1  TO  Li 

510  21=TCL] 

520  TIL  1=1. 00001*21 
530  GOSUB  3000 
540  FOR  J=1  TO  N+L3 

550  XC  J»L+M't-Ln=CX[  J.  U 1-IF|[  J]>/<.0.00001*2r> 

560  NEXT  j 
570  TCL]=21 
580  NEXT  L 

’ . 590  FOR  L=l  TO  PI 

595  21=BtL3 

1 600  IF  21=0  THEN  626 

605  BCL  ]=21«1 .00001 
610  GOSUB  3000 
615  FOR  J=1  TO  N+L3 

^ 620  X[J.L+M+L1+L23=(X[J. 11  ]-H[J]>/<0. 00001*21) 

^ 622  NEXT  J 

I 624  GOTO  636 

626  BtL]=2 1+0. 00001 
628  GOSUB  3000 

i 630  FQP  J=i  TO  N+L3 

632  XC  J. L+M+L1+L2 ]=(XC  J? 1 1 ]-ftC  J ]>  0. 00001 
634  NEXT  J 
636  BCL 3=21 

1 638  NEXT  L 

! 640  21=M+L1+L2+P1 

650  REDItl  VC21.21  3.Ct21  3.HC‘21  3»ur21.21  3.PC21.21  3 
670  FOR  1=1  TO  21 
680  GC I 3=0 
690  FOR  J=1  TO  21 
700  YC I . J 3=0 
710  FOR  K;=1  TO  N+L3 
720  YC  I . J 3=YC  1 1 J 3+XC  K»  I 3*XC  K.  J 3 
730  NEXT  K 
740  NEXT  J 
750  FOR  K=1  TO  N+L3 
760  GC I 3=GC I 3+XCK. I 3+XCK, 11  3 
770  NEXT  t 
780  NEXT  I 
790  FOR  .J=2  TO  21 
800  FOR  1=1  TO  J 
810  YIJ,  I 3=YC  I»  J3, 

820  NEXT  I 
830  NEXT  J 

835  MAT  PRINT  Y 

836  MAT  PRINT  G 
970  MAT  v=iMy<Y) 

980  MAT  H=Y*G 
1010  MAT  PRINT  H 
1015  IF  W1=0  THEN  1025 
1020  N1=N1+HI 1 3 
1022  PRINT  •■MEAN='’; 

1025  FOR  1=1  TO  LI 
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TABLE  B-II.  (CONTINUED) 


¥ 1 


JOJ0  I ’ )*Mt  I*K1 

1035  PfINT  "PHU 'I  n ''-"JPC  n 

1040  NEXT  I 

1050  FOR  I-l  TO  L2 

1000  TI  1 >Tt  I 

1065  PRINT  "THETftv  « 1 « ••  ) = " 1 T[  1 1 

1070  NEXT  1 

lObO  FOR  1=1  TO  FI 

lOSiO  BC  n=et  1 HHC  L 1+L2*M+!  ] 

i095  PRINT  "li'  ■ ; i;  ■ 1 1 

1100  NEXT  I 

1110  GOiLip  3000 

1115  IF  Si  = Z THEN  1130 

1117  GOSUB  3000 

1130  riHT 

1135  GOTO  1010 

1150  ri=o 

1140  FOP  I-l  'U  31 

1150  IF  mBS'.HI  1 ] • ,li3  IHEN  1170 

1160  T1*T1+1 

1170  tiFI'T  ! 

1180  IF  Tl-0  THEN  1330 
1185  P5=F5  3 
1330  GOTO  370 
1330  S3»S1  <,N-F1  ■ 

1340  nflT  U=TkN«>Y> 

13=^0  MOr  R*EUV 
1360  riHT  V-INV\R.‘ 

1370  PRINT  "RFSinilHL  VHRIHNCt  = 

1380  PRINT  'IFmSI  bPUHPES  ESTIMhIEu  OF 

1390  PRINT  ■•tlEBN»";Wl 

1400  FOR  1=1  TO  LI 

1410  PRINT  "PHU.'’;  i;  ■■  '"“iRI  I 1 

1430  NEXT  I 

1430  FOP  I 1 TO  L3 

1440  PPINI  "THEThk  ; I!  '>  = "5  TI  I ] 

1450  NEXT  1 

1453  FCF  :=1  TO  PI 

1454  PFlrtT  "Wv  "n  t I j 

1456  NEXT  I 

1460  NOT  , ' * i' 

1470  PRINT  "COVORIHNLE  NHTRIX  IS 

1480  IlHT  PR  INF  Y 

1481  FOR  .1=1  lO  N + L3 
1483  HI  J I --Hi  ifl  3 1 
1483  NEXT  J 

1490  DISF  ENTER  FllE  ilR  fOR  KEMl  Hl 
1500  INPOi  H3  , 

1510  STORE  DhTH  H'.H 
1530  STOP 
3000  W1=H1-Ht 1 I 
2010  FOP  1=1  10  l: 

3030  PI  1 ]=Pl  n-Hl  I fM  1 
3030  NEXT  T 
2040  FOR  1=1  fi  13 
2050  TI  n-=ri  I 1 -HI  33*  I +11] 

2060  NEXT  I 
2070  FOR  I-l  rO  Pi 
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TABLE  B-II.  (CONCLUDED) 


20S0  PI  nab[  I J 

2090  NEXT  1 
2 '00  EFT 

3000  FOR  I»l  TO  L3 
3040  fit  I ]-0 
3054  NC  I ]«B[  I 1 
305t  NEXT  I 
3340  S1»0 

3350  FOR  J-ltc  TO  N»1  ' 

33b0  Nl J 1-KNh  J • 

33.'0  C l-'.'l+fll  i MhI  n 
3330  ra'T  J 

3390  TKIN'  "tOtl  ..OOrtEtv-  :31 
j3oO  FETOMi 
3310  3rOF 
4^40  ENP 

5ui'>'  I'FF  FN9'  1 -.1C  Cl  I i-llf  ’ 1 t ! ? j ' i T- 3 )- N1  • ' 1 -El  ' 1-  FI  3 1 T [ 1 T - IT 


base  point,  b . Define  the  vector  t , called  the  temporary  head, 

where  the  subscript  1 denotes  the  number  of  the  temporary  head  and  the 
subscript  J denotes  the  element  of  the  parameter  vector,  that  Is 
being  perturbed.  The  vector  ^ ^ defines  a point  In  parameter  space 

about  which  exploration  Is  taking  place.  Let  6^  be  some  step  size 

associated  with  the  parameter  1^.  Let  the  first  temporary  head  be  the 

base  point,  l.e.,  let  ^ ■ bj^.  Assume  | Is  of  dimension  m.  Perturb 

each  of  the  elements  of  the  parameter  vector,  one  at  a time,  so  that 
j ■ I,  2,  ...  m.  Calculate  a new  temporary  head  for  each  variable  such 
that  the  new  t,  Is  that  vector  which  yields  the  minimum  of  lS(t  . 

+ £,)»  S(t  , - & ),  S(t  , ,)].  Note  that  each  temporary  head  makes 

use  of  the  best  value  resulting  from  the  last  parameter  to  be  perturbed. 

When  all  the  variables  have  been  perturbed,  t.  Is  designated  as 

“1  ,m 

a second  base  point,  b2«  It  will  be  the  best  result  from  all  the  per- 
turbations up  to  this  point.  The  vectors  bj^  and  b2  establish  the  first 

pattern.  A new  temporary  head  Is  established  at  a point  on  the  vector 
between  bj^  and  b^  and  twice  the  distance  between  them.  The  process  is 

then  repeated  at  this  new  temporary  head.  If  at  any  Iteration  the  tem- 
porary head  t^  ^ Is  no  better  than  the  last  base  point  the  pattern  Is 

destroyed.  This  could  indicate  either  a ridge  or  that  an  optimum  has 
been  reached.  Using  Che  last  base  point,  the  perturbation  step  size 
Is  reduced  and  the  process  Is  repeated  until  It  converges  to  a solution. 
Figure  B-3  Is  a flow  chart  of  the  pattern  search  algorithm;  Table  B-111 
Is  the  program  listing. 
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TABLE  B-m.  BASIC  PROGRAM  LISTING  FOR  PATTERN  SEARCH 
ALGORITHM 


Rtr  COtiln  . lUtWL  LEMcT  oOUHKt  ' i HflLKH  bErtRLH 
DISK  DEF  rUUCTlOH  H' T ■ mT  MiO"  ! 

STOP 

D=0.  tn 

Din  H H . 0*'  ]•  U.  t - UR  1.  P lU-  < ]>  ! • I H'.  • J.  Mc.[  ,■  J.  fclSC  lO* 
DISP  EMTEF  FILE  NP.  HP  F'T:;“: 

INPUr  Hl.H 
LOOD  iiMT>'  ‘il-n 

DISP  EllTEr  # HK'  CnLFb'Hp  OK'DEF'  » 

INPUT  ^l.Pl 

:<  D!-;.P  LNIE'-  « Mh  ^'..'EFs>  Mrt  OKliEK  : 
j INPUT  L2<Ui 

> FOP  1^1  TO  LI 

;i  ru  'P  t NTf  r * ; 

:i  INPUT  FI  ! . 1 ] 

J NE'.T  I 

'}  FOP  I- 1 IM  L^ 

j DISP  ENTEP  T : I : . ; 

) INPUT  TI I . n 
T ne:.t  i 

.1  u3=Pi 

J IF  Pi  - "1  TiikN  L 3U 
.<  uJ-Ul 

t FOP  1=1  TO  o: 

) DIPP  EMIEP  b'  : I ; ■ . ; 

T iNFur  01  1.  n 

;i  NE'.T  ; 

DISP  tiilFP  -ifHN  : 

” INFUl  111] 

5 t'l-K  ENIEP  OEF-  SUM  SC'UhPES  TOl 

> INPUl  lU-DS 

) FOP  .i  = N+i  3 T'T  QS-’-l  STEP  -1 
S wr  ,1  J--.JL  J-QS  ] 

T NE  'T 

S CO':>UP  30uu 

■ GO'TUE  lO.-U 

1 PRINT  SOM  <^OUmPES  - !rl 

> r3=si 
T 33=3:' 

' MI  3 T .i;  ! T 
t POP  I 1 . J c : 

t El  I.  T 1^0;  I.  1 J 
T NE  ' T ; 

T FOP  i =1  TO  I 1 

j PL  I « . I -P.  1 . 1 J 

:•  ne;:t  i 
t POP  1 . TO  l2 
) T[  T.3  1--T.  I . 1 ] 

) next  I 
j COSUE  .-iST.k’ 
j COSUE;  30UO 
’ IP  Si  33  THEN  E •'U 

■ I T•'ur■  ■ 0 I 
t ni3T-N[3T 

) F (.Ip  1 1 10  05 
» El  I.2  1 = Bi  I-3T 
I ne::t  I 
t POP  1=1  ru  LI 
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TABLE  B-III.  (CONTINUED) 


1 


830  PC  J=P'.  I.  3 J 
840  NEXT  I 
850  FOR  1=1  TO  L2 
860  T[ 1,21=TC 1.31 
870  NEXT  1 

875  PRINT  ■ S'  = iZ3i  '■D=";D 

880  GOTO  740 

890  GOSLIP  1060 

■=>00  PRINT  8011  SUUHkE:.= '!S1 

910  IF  D B1  1HEN  920 

914  ir  ftB8';:2-z3'  = rz  then  ^30 
920  GOTO  320 

930  PRINT  "LOCHL  MINIMUM  REHCHFD' 

940  PISP  ''ENTER  PILE  NP  FOP  PE'SITiiJHL'G  = 

942  f Op  I-'  T'J  N 

944  HI J ] = H[ J + 03  1 

946  NE;,T  J 

950  INPUT  02 

960  STORE  DmTh  liZ-H 

970  STOP 

1060  PRINT  "MbHN=";Mt 1 1 

1070  FOR  1=1  TO  03 

10S0  f PINT  Eo  "5  i; ' ■=  ;B[  I. 1 1 

1090  next  I 

1100  FOR  1=1  TO  LI 

1110  pr  int  '9.  ’ ! i;  ■'  ,=  iP[  I,  I I 

1120  NEXT  I 

1130  FOR;  1 = 1 TO  L2 

1140  PRINT  n ji  = ";t[  i.i  1 

1150  NEXT  I 
1155  PETLIPN 
3000  FOP  J-1  TO  03 
3010  hC  J ]=0 
3020  Ui  Jl=£:[J,l] 

3030  NF’>  i'  J 
3040  31=0 

3050  FOR  J=Q3fl  TO  Mf03 
3060  HCJT=FNFi' J) 

3070  Sl=';i+fl[  J]T2 
3080  NE'XT  J 
3090  RETURN 
3100  STOP 

3500  PEM  PFiTTFPH  SEhPCH 
3510  MI  1 J=MC2 J+D 
3520  GOSUB  3000 
3525  PRINT  MC1]»S1 
3530  IF  SI <23  THEN  3560 
3540  M[  3]=M[2] 

3550  NOTO  3530 
3560  Z3=S1 
3570  MI  3 I=MC I i 
3580  MI  1 ]=MC  2 T-B 
3590  GOSUB  3000 
3595  PRINT  MI  I IjSI 
'■■^FOO  IF  m.  23  THPN  ■’6  3£t 
3610  MI  1 ]=Mt3] 

3620  GOTO  3650 
3630  23=Sl 
3640  MI  3 ]=Mt 1 1 
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(COIfriNUED) 


TABLE  B-IIl 


FOR  1 = 1 10 
3bt'o  ec  1 . 1 l=ta  1 . - ] 
ot.'O  liOSOc:  ji'oO 
3675  PRIM'’  Bt  1 . I 1. 
3680  !P  ■.!  THfO 
36'?0  BC  I-  ) = BC  1.3  1 
370o  GOIu  3730 
3710  bl  I.  ,o=b[  1.11 


ft  1 • ’-ff  ’ . 1 ’ 
37'?0  35='! 

3800  ot  ,i  1 
3810  FOR  1-1  '0  ;.i 
5830  Ft  1 . i 1 = F1  1.31.0 
3830  GOjOb  3000 
3855  FRIN'  Pl  1 . 1 J.  8i 
oS40  iT  1 3.'  IHcH 
.8‘.0  PI  1.  l=FT  1.31 
3860  Go  r I 58  ■•‘0 
5870  3’'  = i l 
3880  Pt  1 . > J = ,'-l  1 . 1 J 
5830  PC  I . I 1 -PC  1.31-: 
3300  GOS'iF:  30..I0 
3305  r-RI-lT  Pt  1 . 1 1.  ■ I 
--■•^lO  II-  THtrl 

33.  0 PC  ! . ; l = pr  I . : 1 
3330  COT'.'  OO-O 
33-40  FC  1 ■ . J=Pl  I . 1 1 


■ 4.\1  K|l-  '-f  1 

3^70  rCR  !=1  TO  .3 
■5 '^80  TC  1 . 1 J=  il  1 . 3 1.1' 
3330  GT'5  'b  3"00 

-;  p j.  I MT  T[  r , 1,  1 

30o0  ir  33  THEN  4030 
4010  Ti  ! . 1 = Tr  1 . 3 1 

403o  GOTO  4050 
40  30  3 3 = S.. 

4040  Tt  1 . ’ l=r[  I . ! J 
4050  '[  I.  1 ]=Tr  1.3  1-3 
4060  ..OBUt  3000 
4065  PR  in:  Tt  1.  ; 1 

4070  IF  8!  3o  MEN  -lo  o 
40  -4  I . 1 1=T1  I . I 
4o7t  30 TO  4100 
4080  Pt  1 J 1 = Tl  1 . ! 

4030  33= 

410o  NE,:'  ! 

4 110  :f  . 33  Then  4; 4,1 

4 ' ' 4 ' " P ■’  1 THPM  ■.  1 . 0 
4 116  :F  i48S<33-35  = D. 

4130  D=D*0.6 
4133  COj'.'P  lO'.O 


TABLE  B-III.  ((XmCLUOEO) 


4124  PRINT  "SS=  522.22 
[ 4130  GOTO  3500 

4140  M[ 1 l=2*Mr  3T-MC2  ] 

4150  FOR  1=1  TO  03 

4160  ec  1. 1 >2*e[  i.2T-e[  1.2] 

4170  NEXT  I 
4180  FOR  1=1  TO  LI 
41'^0  PCI.  ; ] = 2*P[  I.  3]-F[  1.2] 

4200  NE'.'.T  1 
4210  FOR  1=1  10  l2 
4220  T[  I , ; ]=2>T[  : , j_T[  I , J ] 

4230  NEXT  I 
4240  R'ETl.PN 
4250  STOP 
4260  END 

5000  DEF  FNfn  T .silt  1 ]'P[  1 . 1 ]*N[  T-1  ]-P[  2.  1 ]’N[  T-2  ]-M[  1 ]*(,  1-Pl  1 . 1 ]-P[  2.  t ] 


E:' 
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